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ABSTPACT 

This three year proiect was designed to prDvide staff 
development to principals, vice principals and other school 
administration special education issues relating to the 
implement* ticn of Public taw 9M-1«2. Tn 1979, sixtythree ' ^ 
administrator^ participated in a week lona summer workshop, during 
which proiect staff and speakers from within the Division of Special 
Education presented topics such as: discussions on Public Law 9«-m2; 
due process in Special Education: Child study Evaluation Team (CSETV " 
procedures; models for staff development : availability of resources 
irside and outside the school district: and the use of the Special 
Education Program Checklist, an instrtiment to assist principals in 
observino ar^d assessing special education classrooms in their - 
schools. Pretests-pos^test self-rating evaluations were conducted of 
the par<ricipants» perceptions of their knowledge acquisition about 
thirteen selected special education tdpics* Results showed mean post 
ratinas Increased on all thirteen items: these are illustrated in 
tabular form. Participants* skill in the use of the observation 
checklist could not be measured due to insufficient data. Appendix A 
contains the guestionnaire dlstribued to obtain participants* 
reactions to the usefulness of the workshop. A major accomplishment - 
of the proiect was the refinement and fiel^ testing of the Checklist, 
(Author/AEP) ^ 
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This project was'designed to provide staff development to principals, vice 
,principals and other school administrators on sptecial education issues relating 
tp the implementation of, P.L. Sk-]k2. 

' Sixty-three administrators participated in a week long summer workshop. 
Sessions were held daily from 9 o'clock to 1 o'clock at the District Six " 
Administrative Building. Topics were presented by project staff and ^by invited 
speakers from^within the Division of Special Education. 

Among the various subjects presented at the workshop werii discussions on 
P. I,. 94-IA2, due process in Special Education, CSET procedures, models for 
staff development, and ava i labi 1 i ty of resources inside and outside the School 
District. 

Pretest-posttest eva 1 uat ions .were conducted of the participants' per- 
ceptions of their knowledge acquis:ition about 13 selected special education 
topics. Results showed mean post ratings increased on all I3 (100%) of the 
l.tems. 

The participants' acquisition of skill in the use of the observation check- 
list could not be rneasure\j because of insufficient data. 

Based on ratings by the 63 workshop participants, the staff development 
activities were well organized and provided valuable information to the 
administrators. \ . . " 

A major project accomplishment was the refinement and field testing of the 
Special^ Education Program Checklist.' Comments by the administrators who tested 
the checklist indicated considerable satisfaction with its content and format. 
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Project Area: Staff Oevelopment 

Activity Manager: Dr. Libby Goodman ' 

Project Coordinator: Russell Sgro, Eileen Dwell, Herman Axel rod 

Headquarters: Stevens Administrative Center, 13th & Spring Garden Streets 

PBRS Code: 25-05-854 

Federal Code: G007801512 

Qperating Year: 1979-80 

No. Served: 63 Administrators 

No. of Employees: Professional (part time) 3 

Budget: $15,000 

Service Provided: . Staff development sessions on topics related to Special 

Education were provided for school administrators. 

Evaluator: Ted Silber 

PROJECT HISTORY 

This project was funded for three years, 1978 to 1981. Principals, vice 
principals and other school administrators were invited to participate Jn week 
long workshops designed to update administrators* knowiledge of special education 
procedures, programs and resources. A successful summer workshop, attended by 

80 school administrators, was held in August 1978 at University City High School. 

■ > 

Participants indicated in a survey that the sessions were practicTal and interest- 
ing. Project staff developed a revised draft edition of a^ classroom observation 
checklist for special education program evaluation. . • . 

PROJECT IMPLEHENtATION 

In August 1979> the project conducted a one week staff development program 
in special education for administrators. All principals, vice principals and 



special education supervisors were invited to attend. Sessions were held daily 
.from 9 o'clock to 1 o'clock. Topics were presented by the project staff and by 
invited speakers from within the School District's Division of Special Education. 
The agenda included the following: Overview of P.L. 9^-1^2, Update on Special 
Education, CSET Made Simple, In-Service Mandates, In-^Servlce Models-for Compre- ^ 
henslve Staff Development, Due Process in Special Education, Clinical Observa- 
tion Model, Resources in the School District for Special Education, and Resources 



Outside, the School District for Special Education. In addition, a number of 
films and sensitivity awareness sessions wepte presented during the week. Much 
of the third and fourth days of the workshop was devoted to training the parti- 
cipants in the use of the Special Educat ion Program Checkl ist , af^ instrument, 

ft 

developed to assist principals in observing and assessing special education 
classrooms in their schools. 

Project records indicated that 63 administrators participated in the week 
long workshop. The number of participants varied daily, with the average daily 
attendance being approximately 55. 

The project staff (a, coordinator and two special education supervisors) 
devoted the remainder of the project year to formalizing and field testing the 
Special Education Program Checkl ist , developfn^ a procedures manual, and plan- 
ning the staff development program to be offered during the summer of 1980. 
EVALUATION 

Prior to the summer workiihop a self-rating inventory was developed by the 
evaluators and project staff. It was designed to cover the knowledge and 
skills needed to educate effectively special education students. The inventory 
was distributed to all p^rtlcipants%t the first session and again at the last 
session of the week Icoci workshpp. Using a four point scale, administrators 
were asked co |ate their current level of knowledge on 13 selected items 
pertaining to special education, A total of ^3 administrators completed both 
the pre- and post rating portions of the self-rating inventory. To measure 
the effect of training on the participants' perceptions, a comporison of mean 
pr^-ratings witltmean post ratings was performed. 

The evaluators also summarized responses on the Special Education Program v 
Checklists completed by the participants after viewing a film depicting a 
special education classroom. These responses were to be compared to trainers' 
responses to calculate the extent of agreement. 
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TABLE 



INCREASESNJ N PRE- TO POST-MEANS ON THE SELF-RATING INVENTORY. AUGUST 1979 



ffs, 



ITEM 



1. ComponafvLa of Special Education classroom ' 

2. Evaluating S-pecIal Education classroom 

3. Selecting films for staff development 
• Assessing staff development needs 

5'. ■ Obtaining resources for staff development 

6. Knowing Information for CSET forms 

7. ^^ FacM Itat Ing the work of CSET 

8. Role In due process hearings 

9. Increasing faculty's sensitivity to Special o 
Education pupils 

10. Availability of resources In School DIstrLct 

11. Availability of resources outside School District 

12. Knowing characteristics of SED, EMR/ED, or LD 

13. Knowing appropriate programs for SED, EMR/ED or LD 



P RE-MEAN 



2. 09 
}'M 
1.86 
2.21 
2.1/» 
2./»2 
2.05 
2.30 

1.95 
2.07 
1.81 
2.21 
1.7'» 



POST-MEAN 



3.'»7 

3.37 

3.k9 

3.33 

3.67 

3.58 

3.2} 

3.30 

3.'»'» 

3.'»9« 

3.53-^' 

2.95 

2.77 



INCREASE, IN MEAN 



+1.38 
+1.'»9 
+1.63 
+ 1.12 
+ 1.53 
+ 1.16 
+1.16 
+1 .00 

+1 .'»9 
+1 .k2 
+1 .72 
+ .7k 
+1.03 
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A queatlonn-alre d^stgneti to gacher participants ' reactions to staff 
development activtfr^a w^s d'latrl bgtecl at the final session. The Instrumeaf 
used a five poht ^cAlej t;^ Dieasgre extent of satlsfactjon with and parcelve'cl 
usefulness of th^ Wo'^Ks^ftp In general, and to Individual topics In particular. 
Space was provided fAr the listing of the best and worst features 
of the workshop, cwflments qV suggestions for future programs were also solicited. 
Mean ratings on a>l Che I tettis ^were calculated and a list of the participants' 
comments and re^cCioOs ware compiled. 

One of the ^(Jtlv' 1 1 1 to be accompl i shed ^by the. project during the second 
year was the fUM testing of the special Education Program Checklist. Prlnd- 
. pals, vlce-prlnc/(?^l^, ^nd other administrators were asked to use the checkljst, 
which they helper! to ti^^elop'durl ng the workshop, for the purpose of monUor-Ing 
special educatlQfi (jl^^5ro6ms in their schools. To measure the extent of use and 
assess the usefuln^s^ the checklist, a ten Item quest lonnal re was developed 
by the evaiuator tir(?j^ct staff and sent to 63 participants. The instrument 
was designed to &]\(^\\ responses both to logical and -practical aspects of the 
checklist (I.e., a^^, ^h^ {tetns on the checklist relevant and.Is.It a useal 
instrument). Participants Were asked to assess the usefulness of the checklist 
even I,f . they ^Id nOkf ^a^/e the' opporturii ty to use It in the classroom. Responses , 
were stimmarlzed gtic) s^nt to project staff for use In the final revision of the 
check list, 

FINDINGS " ' .-v 

Objective 1^ participating principals/vice-principals will acquire know- 
ledge ^nd skills related to the monitoring of programs a^ 
<)et^erminecl by mean post ratings which are higher than mean 
pr^'^ratrn^s on 75% of ^he items on a participants' self-ratina " 

A summary of r^^J^C' -^-^ Qn the self-rating inventory is presented in TabTe 1. 
Using ratings th^t r^O^^d frQtn 1 (l know vi rtual ly nothing about this) to V 
(I have a better t|i^n average kh'owledge of this) , ^dmThistrators-rndicated thei r-' .. 
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bV^l of knowladg^ on spacl^l aducatlon topics both bafor© ^and aft^r tha staff 
c|0V^lopniant program. Th« participants * parcaptlon of thair currant laval of 
Kric^WUdgft Improved In all araas as shown by Incraasaa In maan post ratings f oP|* . 
th© 13 Itams, Prior to tha workshop, tha survey Indlcatad that administrators* 
pi^r^alved knowle'dge was lowest lo'^tKa'^reas of programming^ for SED, EMR/ED or 
KO students (Item 13) and In the availability of resources outside the School 
Q|5t:rlct (item Tl). Means calculated after the workshop showed that the greatest 
Q0\t\ In parceVved knowledge was In availability of resources outside the 
Sc;h<iol District (Item 11). Conversely, programming for SED, EMR/ED or LD 
Stuclents was among the Items that Increased the least. Based on the survey, 
administrators felt that they had enough knowledge to perform adequately In llofl3 
are^s. The only exceptions Involved Identifying and programming fdr ISED, 
EHR/ED or LD students. This objective was met. 

f Objectjve 2; By the end of the institute's observation training session, 
principals/vice principals will have acqui red' ski 1 1 in the 
use of the observation checklist to the extent tha'l for 85% 
of the checklist items, 85% of them are In agreement with 
trainers ' rat fngs. 

Because of Insufficient data this objective could not be measured. After 
» » * 

ret^iylng training on the use of the classroom checklist, participants were asked 

to <::ornplete a checklist while viewing a film depicting a special education class- 

r^oo^. Participants' responses were to^ be compared to the correct responses as 

determined by the trainers. However, t.lfs xould not be accompl I shed s I nee many 

U^s on the checklist were not represented on the video tape used to test the 

participants. An evaluation of this objective was not feasible under the 

c|r<:utnstantce$. ^ ' " ' 

Objectjve 3: By March 1980,^ at^^leasr 75% of the participating principals/ 
vice, principals will have used the observation checklist in 
the monitoring of their special education programs, as indi- 
cated by their responses to a survey. ' 

Surveys were sent to 63 principals, vice principals and administrators who 
Pariclpated In the summer workshop. Thirty-four of the administrators, repre- 
senting the fol lowing levels, returned the questionnaire: 



Mld^la h 

Junfor^Igh 3 

. Sanlor High 3 

Special Cantar 1 ^ , * 

A total of k] classrooms Involving tha fjtfilowlng axcapt lonal Ulas wara vlftl,Ud 
by administrators ; I 
/' SED 11 

^ \ EMR*. ' 9 . * \ * 

SP| 3 

HH < 1 . r 

* ; RR . 1 . ^ . 

. ' flo9p1t;,al / 1 ; ^ ' • 

Twenty-two of the respondents .reported using the checkl/st with special 
education classrooms In their schools.. Tha 22 users represented 35%* of the • 
total' number of participants and 65^ of those who returned tfie questionnaire. 
This object rv6 was not met.- ' .J , ^' 

ADDITionAL FINDINGS . ^' , . , ^ 

Question 1: How useful was the checklist^ In helping administrators Identify 
strengths and weaknesses regarding the sj^ecUl;_isducatlon classrooms In thejr 
sphool s7^ ' 

While the majority statdd that the checklist was helpful ^In all areas, ^pore 
'administrators found It suitable for Identifying aspects -of lEP's and record 
keeping (88^) than for planning cl ass rooa^'fnteract ions or utilizing aides and 
ancillary services (7^^). (See Appendix fy) , , 
(Question 2; Is the ohecklist"^a workable and usable instrument? 
Responses Jp J te^ the cl^arlty, consistency completeness , - • 

relevancy and ease of us!ng the checklist weTe alf answered posltiyely'by at 

least" 85% of the respondents. , • ' 

....... ^ . ... ^ ^.^ — ^ 

..Approximate if 75% of the. administrators felt, that use of the checkl i st woul d 
not cause disruption to the classroom routine or intimidate the teacher. A 
summary of the responses to the Principals' Questi6nnaire is presented in 
Appendix A. " • . 
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^Mej^jlpn }\ What wgr^^^^^U^^^^^ \ r^^ct: Ipo^ ^nd c^^^^niiiiru^ r^gir^^Hm j 

Workshop partlalp^ncs mrn glv^n a qu^^Uonn^lr^ Pallowinq the goCpletlon pf 
Che wall long ^e^^lon?^. Reiult^ ^r^ Jiwmmarlas^d In T^hl(^ 2, 

Table 2 

PARTICIPANTS' RATINGS OF THE PHILADELPHIA 
TRAINING PROJECT FOR SPECIAL EDUCATION SUPERVISORS 
AND PRINCIPALS, AUGUST 1979 



Category 


Mean Ratings 


Content 




Interest 


k.2 


Organ I /at Ton 




Practical i ty 


k.2 



Pace'V 


66% ?ated 


it 


"ideal" 




17% rat.ed- 


it 


"somewhat slow" 




17% rated 


it 


"sqmewhat fast" 


Interact lon'^ 


' 62% rated 


it 


"ideal" 




' 19% rated 


it 


"too little" 




.19% rated 


It 


"too much" 



-^'^Pace ^nd' Interaction are rated on a scale frofn 1 (too.slow, 
too little) to 3 (tdedl) to 5' (too fast, too much). All 
other categories are rated on a scale from 1 (low) to 5 '(.high). 

Using a five point scale ranging from 1 (low) to 5 (high), participants ' 

rated the entire week long proceedings on ^he dimensibns of appropriateness of 

content, interest, orgapization and practical ity. All mean ratings were above 

4.2. Participants also rated the Vess ions on interaction and pace. For these 

dimensions the ideal rating on the five point scale was 3- The'majority of 

participants ratea^both pace and interaction as 'Wdeal." 
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In addition, reactions on the usefulness of Individual topics were gathered. 
All mean ratings were above j*7-on a five point scale. The responses are presented 
In Table 3. 

Table 3 

PARTICIPANTS* MEAN RATINGS ON TOPICS PRESENTED AT THE 
PHILADELPHIA TRAINING PROJECT FOR SPECIAL EDUCATION 
SUPERVISORS AND PRINCIPALS, AUGUST 1979 

Topics Mean Ratings 



Sensitivity Awareness 


4 


.2 


Films 


3 


.8 


Use of Special Education Program Checklist 


k 


.2 


CSET Made Simple 


3 


.8 


In-Service Models for Staff Development 


3 


.7 


Using Films for Staff Development 


3 


.8 


Clinical Observation Model 


3 


.8 


Due Process In Special Education 


3 


.8 


Resources in the School District 
for Special Education 




.3 


Resources Optslde the School District for 
Special Education 


4 


.5 



CpNCLUSlONS . 

Objective 1; addressed the self -perception of acqu i red knowledge and skills by 
the prrtlcipants duripg the workshop. A comparison of mean pre-ratings with mean 
post ratings indicated that perceived knowledge was increased on all 13 (100|) of 
the items. This exceeded the projected criterion of 85%. Thus, this objective 
was attained. 

The second objective of the project concerned training administrators in the 
^se of a classroom checklist. The data from participants could not be compared to 
the "correct responses" Identified by the trainers because too many assumptions had 
to be made about the si tuitions presented on the video tape. The fact that this 
problem arose led to the redesign of the assessment procedure. The third year of 



training will utilize slides and a narrationto depict a special education class- 

p 

room which participants will rate on the checklist. 

The project's third objective specified that at least 75% of the workshop 
participants will have used the observation checklist during the school year. 
Twenty-two of 63 participants reported using the checklist. The number of 
administrators who reported utilizing the checklist was less than the criterion 
stated in the objective. Thus, this objective was not attained. 

Comments of the users were favorable and, in some cases, enthus last ic about 
the development of the observation checklist. 

Additional findings showed that the admistrators perceived the checklist as 
well conceived and valuable as an instrument to guide their assessment of special 
education classrooms. 

Aside from the romplaintS of poor vetit I lat ion , the comments of the summer 
workshop participants were potsitlve. Responses on the Participant Questionnaire 
indicated that the information provided was found to be of value by the partici- 
pants . 

A ^-major accomplishment for the project's second year, was the refinement 
and fie^id testing of the Special Education Program Checklist, and the drafting 
of ^ manual to guide administrators In using the checklist in special education 
classrooms. Its value as an observational instrument In determining compliance 
with P. L. 9^-1^2 was attested to by those administrators who used It. 

Plans for the third year of the project inclt^de finalizing the checklist 
and manual and disseminating the products to principals and other administrators 
who are responsible for special education classes in their schools. 
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APPENDIX A 



Analysis of Responses to the Principal's 
Questionnaire on Usability of Checklist 



During a summer v^«rkshop, principals and administrators were trained In the 
use of a special education classroom checklist and asked to utilize the 
checklist in their schools. To assess the usefulness of the checklist 
questionnaires were sent to the participants. Responses representing the follow- 
ing levels from 34 principals and administrators were ^-eceived. 

Elementary 23 

Middle k 

Junior High 3 

Sertior High - .3 

Special Center 1 

The participants were asked to respond to the following questions: 

I. Did you use the checklist with any of the special education classes In 
your school? • 

, YES ... 22 ' 

NO ... 1 2 

Sixty-five percent'of the 34 respondents reported use of the checklists I nir 
Uo'TalVtles""' """""'"S ''^^ foaSwIng ex. ' ■ 

SEP.. . 11 

LD 9. 

. , EMR 9 

SPI "... 3 

HH 1 

RR........... .... 1 

Hospital...' : 1 

I- 

2. Could the checklist be used without unduly disrupting classroom routine? 

YES ... 25 ^ 
NO ... 9 ' 

Seventy-four percent J^t the use of the checklist did not cause disruption 
in the classroom, .. 

^ Of those participants experiencing disruptions, the Inacdess ibi 1 1 ty of 
records (lEPs, student files) and the need for class coverage while 
questioning the teacher were reasons" most frequently cited. 

3. Do you think the checklist intimidated teachers who felt that their performanqes 
were being rated? 

YES ... 7 

NO ... 26 

N/A . . . 1 ^ • 

o • , -10- 
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Seventy-six percent felt that their teachers were not-intimidated by the 
use of the checkl ist . i 

Confluents Indicated that discussion and review of the checklist prior to 
visiting the cfassroom helped alleviate any concerns teachers have 
about rating their performances, 

'l. Could the checklist be reasonably completed during one visitation period? 

YES ... 20 
NO ... 14 

Fifty-nine percent completed the checklist during one classroom visit. 
Twelve percent needed as many as three visits to complete the checklist. 

5. Do you think the use of a checklist will cause problems with P.F.T. or the 
Special Education supervisors? 

YES ... 9 
NO ... 22 
N/A ... 3 

Sixty-five percent felt that there would be no objection to the use of the 
checklist in the classroom. ^ 

Of those who felt P.F.T. might object, the close supervtsfon of teachers 
and the attempt for accountabl 1 Ity were mentioned as reasons for potential 
grievances. 

6. Do you feel the rating scale (5*4''3''2-l) format Is appropriate and easy 
to use? 

YES ... 32 
NO ... 2 ' 

Ninety-four percent considered the format suitable and simple to use. 

7. Are the descriptions under the rating scales clear and consistent? 

YES ... 32 
NO ... 2 

Ninety-four percent found the explanations to the rating scales to- be 
understandable and consistent. 

8. ; Was the checklist able to help you In Identifying strengths and weaknesses 

In the following areas: 

YES NO N/A 

lEP 30 2 2 

Record Ke^jsplng ' . ' 30 2 2 

Materials and Equipment 28 4 2 

Plaiining for^ Classroom Interaction 25 5 ^ 

Working with Other Personnel 25 3 6 



8. (continued) 

While the majority of respondents felt that the checklist was helpful in all 
areas, -"ore found it suitable for ident i fy ing aspects of lEP's and record- 
keeping (883;) than for planning classroom interactions or utilizing aides 
and ancillary services i7k%) . ^ 

9. Based on your knowledge of what constitutes compliance with P.i , Sk-ihl^i 
IS there anything you would add to the checklist that would heFp you • ' 
determine whether yourclassroom was incompliance? 

YES ... 3 
NO ... 29 
N/A ... 2 



10. 



Eighty-five percent stated the checklist contained complete Information 
as an aide In determining compliance with federal law. 

Are there any Items on the checklist you felt were unnecessary? 
VES ... 1 

NO ... 31 ^ 
N/A ... 2 

Ninety-one percent felt the checklist contained items relevant to 
P.L. 9'»-l'»2. 
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